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Th^ docuaent X^H^vs the Phas/)Achiev<aent Systea 
,|PAS) , a sastexy-oriented instructi^onal aethod, 'bein<g utilized to 
teach biology at loaa State vQniTersityJ The systes is designed to 
reduce student failures f roi conpetitive, nonrepeatable exaainations 
'and presents course content Material in a nodularized fora. A 
cfonparison with traditional lecture instruction is nade. (SL) 
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^ Evaluation df. the myltidlmensfoxial ' ^ • 

" ^ ^ ' . ' ' \ . , ' * 

N of traditional arid mastery Instruction, ' ' ' 

/ ' • - ' * o • 

ttxiderij^xiassrw^ performance Is' typically' evaluated thro'ugh a fixed 
number, of ^nrep^atable , competitlve^exaiA Many educators^ have^ ^ 

begun to question such a system both 'as a method of Instruction .and a^ *aid 
to leai^in^, " The competitive nature of the examination .procedure is par- 
tially at fault. Because knowledge is evaluated relative to the scares 
of other students rather than against fixed standards, a stxident with medi- 
ocre ability or poor precourSe preparation may be frustrated by his In^ 
ability to demonstrate an acceptable level of performance. Secondly, me 
competj-tive nature of tfte examinations' may be^debllltatlng to^students who 

tiave ^equate ability, but have"*Aiff iculty coping with the* anxlety^arettslng' 

• . * f * V i • 

nature of- the evaluations. Aside frpm the competitiVfe/^ttfre of the t^sts, 

their rigid and nonrepeatable scheduling may hamper learning, "Colleee ^ 

students must* cope with a great number of personal and academicr demands 

upon their^ time. Often, they take examinations withojit adequate prepaija- 

tioh. In §uch cases., the strictly scheduled course then pushes students 

onward into new material giving little Incentive for the mastery of -material 

^already testeid, . ^ ' " * ."^ n 

Although not a panacea for all of the problems affecting large lecture 
sections, mastery-oriented instructional systems are designed to offset 
most of the difficulties just mentioned. As evidenced by a recent article 

•in Science (Kulik, Kulik and Carmichael, 1974), such teaching. methods have 
been having a great Impact on college-level science education. " The Phase 



An earlier version of the p^per was presented at the Annual Meeting o.f the^ 
I^wa Academy of Science,. April 19; 1975. - ^ '* * ^ 



Acihievement Systen (PAS) (Dolphin j Fr^e, Covert and Jorgensen, 1973),. 

developed to teach introductory ^iology at Iowa* State University, is one 

example of, a mastery-oriented teaching technique and is the basis of this 

comparison of traditional an<J mastery sy^t'ems^ 

PAS. features preset grading standards, repfetitive testing and*.mdd- 

ularized course content. Lectures ^sfre combined* with a study guide stressing 

behavioral o'bjectives, and , a tape library for review. Exam's over aW of 

the required hine phases (units) can be taken in any order and urTto. flv^ 

times. The b^st qpore on a , given i^xit examination is used in determining 

'student grades. Grades are. awarded by a fixed grading policy which re- * . 
] , . ' . , 

* ' _i * 

•quires a minimum average (33%) oil a minimum number of phases (^) before. 

a final average is calculated. Once these minimum* thresholds have Been * 

achieved', the final grade fis determined 3olely by quality of performance. 

An javerage of 85-100%^ constitutes and A,' 76-84% a B, 6f-75% a C, and 53-66% 

a D. Students passing at least six, but not eight phases, receive an iit^ 

complete and are given an additional quarter^ to^ bring 'their ^erformattce up, 

to threshold levels. To alleviate problems due to the magnitude'of 3ee- 

retarial chores, test generation and -all record keeping is accomplished 

*by computer] Total cost for this service is about eight cents per s'tddent 

per quarter. 

1 The present research contrasts th^ affective cpnsequetlces of^^lAS ^d 

a traditional method of instruction. Here, traditiSnai is ^dpf Ined. aj5 a 

\ <^ * s 

lecture. approach with* p'erfoMiance e through four equally, 'weigh ted 

competitive examinations.* For the comparison, data from 99. pales and- 92 

females enrolled ±\i a PAS seci^ion were compared with dat^ f i?o!ffT:02L^ale8^ and 

92 females from a tradijtional . section. ' * ' ^ ^ . 



Affective reaction^ to instructional methods and subject rmatter have 
been citad as .a positiv^, benefit of the mastery method of instruction 
(Kulik, et al», 1974). Unfortunately^ data to support these deiims have 
come from very simple instrximents - usually a single item. Because the 
iii5)act of any iiisfructional system is multidimensional, 'comparisons made 
between system^ should; evaluate as many facets of course impact as possible 
Positive consequences in one particular area may' be offset by negative 
consequences in -other areas. Our evaluatiion procedure attempts t9 take-^ 
global look at reactions to mastery and traditional instruction and also. I 
to compare these two systems oh more specific dimensions*, ' ' 

The original scale (see Appendix 1^ was consttucted in the following 
manner. Based upon a thorough review of the mastery-learning literature, 
we gathered a group of statements thought to reflect the -positive and neg- 
ative consequences of mastery-oriented-^couraesi^^ScSie'it^mff were'^then 
constructed to approach these topics. To controrl tor response set. Items 
were *coianterbalanced for positive affect. 'Additional ti^irelated items were 
included on the questionnaire to obtain information -unrelated to this 
research topic. These items ^ai^ several others chowiiig low interitem 
correlations were excluded prior to the factor analysis. 

Because the questionnaire was administered acaloss subjects. (Sex x 
Method of instruction) expected t6 differ in the^ir responses to the Items, 
a method to remove between-cell variation was utilized. Sum of squares 
and cross-product matrices were computed within cells and then pooled. • 
The correlation matrix ^>roduced from this procedure gives the best indi<:- 
ation of the factor structure for the total population of students respondi 
to thd -questionnaire.' A principle components factor analysis rotated to 
Yarimax criterion of simple structure was then. employed. The solution 
yielded^ 5 factors (21 items) and was judged to be adequate according to the 



following criteria: a) 55% of the var^ace ajnong Items' was accounted ^for 
by five factors,' b) eigenvalues for these five factors Vere all greater 
then one,, c) ite^ tended to load on a single factor and d)^hlgh item com- 
'.munalit|ies were produced. The five factors were labelled ;study habits, , 
general evaluation i tests and grades, perceived freedom, ajid intellectual 
value.* Items loading on each of these factors are Indicated on the handout 
depicting thfe rotafid facto^ matrix. Undetlined loadings are- used to 
designate the items Refining a given factor. , • 

In order to evaluate the affective 'consequences of • the. traditional 
and mastery courses, subscale scores were constructed for each student. 

The five subscale scores indicate the average raw scale values for items 

* * ■ ' t 
loading on each factor. For example, a student's -score for Perceived ^ 

Freedom consisted of 'the average of his responses to questions 23 and 26. 
Ali questions that were .negatively keyed were reflected prior to the for- 
mation -of subscale scored. - * . * 

A METHOD by SEX MK^OVA was performed .employing, the subscale scores \ 
as correlated dependent measures. (f The results indicated a highly sig- ^ 
nif leant- effect of METHOD,. F(5,4fl> 14. 69 ,£i .001, with PAS being evaluated 
'more positively, by both mal^ and female students. Univariate ANOVAs pier- 
forme4 on Ba9h subscale indlcjated that /this effect was primarily' due to 
the\ perceived Freedom and T^s.ts and Grades factors (p£.6oi). The same 
direction of effect was- observed on the other factors, but these differ- 



ences did not/ r^dh an acceptable levep. of statistical significance/ 

\ I Idiscussion • f , 

The refifults p^^tMs i^estlgation suggest an ^advantage f ar^ the mastt^ry- 
oriex^ed methdd of lnstru(ition. The questionnaire results indicated that 
students foynd tlfe noncompetitive evaluation system and the opportunity to 



achieve through dirigenqe to be the. major advantages of the" Phase Achieve- 

me^t System'. "Such findings support claims made by many authors advocating 

» ' Ik 

th^ mastery method'. - , ' ; 

Aside from the data which it has' provided, jthe assessment tool devel- 
oped here provides a majt)r step forward. Although the evaluative instru- 
ment is still at a crude level of development, it does provide a ma^of 
ad-^ance over the simple instruments which have preceded it; Future, efforts 
might he devoted to adding items which woT^Ld load on those fa^rs defined 
by oidy a few itans 6r to the application of this assessment technique 
other comparisons of traditional and mastery methods of ^instruction. 
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Rotated Fabtor Patt«zn Matrix for the Scale '' 
to Measure Affective Reactions to lastru^tioiial ^teas 
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The underlined loadliigs are eomldered to define the factor. 
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Biology 101' Course Evaluation Questlonnlare 

We feel that the *real use of an* evaluation Is to Improve the course for future student s > 
For that reason, we would^ like to use your experience in thi|» coUrse as the basis for 
evaluations which may strongly, influence how we structure the coufie in the future. Try 
to .divorce your opinions of the coursW^ subject material, instructor, and text as you . 
answer the questions. . ' • * " * , ' ^ ' 

\ ^ ' • . . ' . 

Identifying Information ^ , 

Before you answer any of the questions on the Questionnaire, complete the following: 
(1) Print your name on the unswer"" sheet| (2) record a lecture sectipn identification 
number in the following way. ^At the upiper right pf the answer sheet is a blook labelled* 
identification number. In the first row in the column indicated by the arrow, place 
your section number according to your lecture t^e as Indicated below. 

. Sec. No . , Day and /Time 
• -4 MWF ll:Q0-U:5O 

5 m? 12:10-1:00 • . 

(3) now in the column beneath the section number record .your social security num))er,. ^ 

(4) encode your secti<& and .social security nianbers by pencilling in the slots correspond- 
ing to the numbers in the. column. (5) Leave all other Identifying informaf:ion ^blank. 

Please use the following scale to indicate the degree' of your Agreement or disagreement 
- with each of the opinion questions on the following ptiges. Mark your answers on the IBM 
, answer sheet. Be sure the nianber of the statement agrees with the n]umber on the answer ^ 

sheet. Make your matks heavy and black. "Erase, completely , any answer you wish to 9hange. 

Do not leave any blAnk spaces. . ^ 

-9 ■ very strong agreement 4 » ,slight disagreement 

8 « strong agreement' « *' ' 3a moderate disagreement 

1 « moderate agreement * . 2 « strong disagreement^ ' * 

6 « slight agreement * . 1 « very strong disagreement 

^ « neither agreement nor disagreement ^ . ^ , 

These questr^onnalres will be analyzed by an Independent agency after course grades aife 
awarded, ^lease^be honest in your responses. , 

Background Information (Factual Information; Chpose appropriate response). ^ 

1. Class standing:- (1) freshman; (2)^ sophomore; (5) junior; (4) senior;' (5) other 

2. Grade you feel you will receive: (1) A; (2) B;V(3) C; (4) D; (5) F; (6) Incomplete (I), 

3. Grade you feel'' you should receive: (1) A; (b) b\ (3) C; (4) D; (5) F;. (6) Incompleted) 

4. Major ^rea: (1) Life sciences; (2) physical sclimce and math; (3) arts and humanitlesj 
(4) engineering; (5) agriculture; (6) hcrae ecoliomlcs; (7) education-. 

5. Agei (1) 20 or under; (2) 21-25; (3) 26-30; (4) 31-39; (5) 40 or older' 

6. Student's expected grade" po<^it this quarter: (1) 3.5. or up; <2) 3.0-3.5'; (3) 2^0-2.9; , 
'(4) 1.0-1.9; (5) below 1.0. , . * . . 

7; Reason for taking course? (1) requirement for life sciences major; (2) /o»* fulfill 
group or college requirementf ; (3) just interested; (4>y don't know. 

8. How many credits' have you taken in other college level courses In the life sciences: 
(1) 0; (2). 3-5 credits; (3) 5-10^, \(4) 10-15; (5) more' tU^ 15. ' 



How many credits have you taken in college level courses in the physical aciei(ces 
(Chem;Physic8;GeolO: (1) 0; (2) 3-5; (3) 5-10; (4) 10-15;\(5) mor^ than 15. ^ , 



.10. Are you currently enrolled In any of the' following courses^' (1) lOlA; (2) I02A; 
(3V102B; (4) 103; (5) more -than 'one of .the abov^. 

11. How many hours per week did you tpend on* Biology 101 outside' of , class? (1) l' hr; 

' (2X 2-4 hr; (3) 5-6 hr; (4) 7-8 hr; (5). 9 hr or more. . ^ 

12. How many lectures did ypu miss during the quarter? (1) 0; (2) 2; (3) 4;, (4) 6; 

(5) 7 or more. , ' . ' ' . ' 

Opinions about Course (Use 1 to '9 scale on cover page; do not use 0) 

13'. The textbook, ^As not suitable for this course* * . ^ 

14. Ventilation, seating arrangements, fpd lighting vera adequate In the lecture halls 
' ^ used *ln this course. ' - . ' • ' 

15. tK^ study guide was of little use In preparing fotj^the examinations. 

16. Ol'd tests' from previous quarters a^e the best way to prepare for the examinations in 
this course.' . ' • , 

• ) , 

17. Compared to o£her courses I, took this quarter, I fpund myself spending too much t;^e 
> on*Blology 101 for the college* credit assigned* ' , * . 

18. It w^s importaivt to me to have the' study guide in order to organize the subject 
material. ' \ • ' f ' ' • 

19 r In .this course, cWnjlng f^r tests was the most effective means to obtain a higK 
grade. \ V \ ' - " 

\ J ' ' 

20. Tests were useful to\me as a learning aid. - ^ \ ^'^ 

\ , ' . / • • \ ' 

21. The tests were an adequate measure of my knowledge of Biology 101 and will allow the 

instructor to '^asslgn me the grade I deserve. 



22. In this course the flnal\gra3e will be more related to intrelligence than to study 
effort expended. ^ Xij * - ' 

23. I felt that I could, determine my grade in this course more than in most ither 
L ^coursed at I'.S»U, ^ ^"""v^ 



25 . Too mWh lemphasis was placed on testing and grades in >this course. 



it^ning* 



24. Compared to other courses at I.S«U.,the tests jLn this*cpurse were more threatening. 

; ai 

26^ I adjjasted my study habits during the course according to the scores I received on 
tests. ; ' 

27. The coursa allowed me** to pursue in depth, understanding in areas«,that personally - 
interested me. ♦ . * . ' • 

28. I feel that this course should be recommended only for life science majors. 

29. I had to officially drop other courses frfxn my schedule in or^er to keep up^ with 
the work- in this course. , , ^ , 

^3p. IXirlng the fatter half of this course I had an. accurate impression Qf the grade J - 
that I .would receive. ^ 

31. I feel that tlxis .course has ^lot conl:ributed significaritly to my understanding of 
> the basic processes of living systems. 

^ * ' ' ' ' I 

32. My personal interest it>* biology was high before takjaag 'this coursjr. 

33* The number of exams was *not ifdeqiiate to test ng^ understanding and keep my interest.* 

34yp^ The exams in this course were unfair and tricky. 

35I Exams in this course emphasize factual material at the expanse of^m^erstandlng 

\ concepts. ^ 

u - . 



36. My personal Interest In biology was high after taking this course. ' 

37. Regardless of >my grade, I fee^l that ^ have mastered the relevant conten| of 

^ Biology lOl. ' ^ • , ' ^ 

38. I frequently used the tape recordings In the Library to review the course saterial* 

. 39.'* I was avare that Biology 101 was taugh£ this quarter using two different methods 

(PA% and Traditional). ' \^ . - * 

4p. From what I know about the other way of teaching the ^course, I would prefer to be 
' In the other type of section. ' 

41, The grade standards Inthls course are too^hlgh. 

42. ^ During the course, my Interesp Ip biology developed to the point thl\t I wanted to 

spend-more time on Biology 101 than I had originally expected. ^ , ^ . ^ " 

'43. This course has encouraged me to deyelop^^ood sjtudy habits. ' - 

44. This course has encoufagel^ me to develop critical reading Skills. 

45. I .was disappointed that Biology lOl dealt with abitract blol6gical proc^^es and 
not the 'Structure atid functipn ol plants and animils. * 

^ ' * n * * 

.46. My final grade in this course wlll^be limited because I lack a background* in the. 

-sciences. 

47. I was unable to inkster the abstract generalizations demanded in this course. < 

48. Tills course has stlimilated my desire tp take additional biology courses.' > k 

49. I think that this is one of the worst courses I haT>e*had at I.S.U. 

50. This course ^forced tne to regard myself as being unable to qpqf^p^ehehd the basic ^ 
coiicepts of Siology; ' ' ' ^ "^^^ 

Opinion of Instructor • • ^ • 

: , ^ : - ' ^ ' - . . 

51. The instructor did not- interpret abstrabt ideas ^and theories clearly. ' 

52. The Ipstnictor contributed to my Interjist in his subject. . * 

53. The instructor has increased my skills in thlnklrig. . 

54. ' The instructor has helped broaden my intefejsts. v * * ^' ^ \ 

55. The instructor does not stress Importantrmaterl^^^ * • . 

56. The instructor^ makes good use of examples and lll^pi^at ions'. 

57. The instructor'has not motivated* me todo my best work. • - • 

58. The instructor does itot inspire class' confidence by his knowledge of the subject 
material. . ^ " , , ^ 

•59. The^instructor has g^ven me new viewpoints and appreciations. ^ 

60. The instrhdtor is not cle^r and understamdable in his explanatlo^. ^ " 

Return -the questionnaire and completed* ansJir ^heet on Wednesday, Nov. 20, at 9:45 
at your finar examination. * , I' " 



